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"PROCESS FOR MEASURING THE VALUE OR PERFORMANCE OF AN 
ORGANIZATION OR INTANGIBLE ASSET" 

ABSTRACT OF THE DISCLOSURE 

A process for measuring the value or performance of an organization or 
intangible asset provides a graphical illustration of the performance or value of an asset 
by (1) establishing first and second variables related to the value of the intangible asset 
of interest, (2) establishing a series of performance criteria statements probative of the 
value of the first and second variables, (3) generating first and second total scores based 
upon the extent to which individual statements accurately describe the intangible asset 
of interest, (4) creating a chart having a first axis relating to the first variable and a 
second axis relating to the second variable, (5) plotting a point on the chart, the point 
being located at coordinates corresponding to the first and second total scores, 
respectively, and (6) using the chart in making at least one decision regarding the value 
of said intangible asset of interest. 
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PROCESS FOR MEASURING THE VALUE OR PERFORMANCE OF AN 
ORGANIZATION OR INTANGIBLE ASSET 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The invention relates in general to processes used by consultants, analysts, and 
executives for evaluating intangible assets, and in particular to a system for providing 
a definitive measurement of the value or performance of a technology, an organization, 
or other intangible asset of interest. 

2. Related Art 

Systems have been known for producing a grid-type graphical representation 
of the relative value of two dependent variables. One example of such systems is 
known as the Risk Management Matrix, used by the Boston Consulting Group for 
portfolio analysis. The Risk Management Matrix uses "Relative Market Share" and 
"Growth" as the two axes on a four-quadrant grid. These terms represent cash 
generation and cash use, respectively, and thus two dependent variables are represented 
on the axes of the grid. Such analyses are discussed in detail in "A Manager's Guide 
to Technology Forecasting and Strategic Analysis Methods," Stephen M. Millet 
and Edward J. Honton, Batelle Press, 1991, which is incorporated herein by reference. 
Further, methods of analysis such as the Risk Management Matrix are qualitative, and 
the grid axes are normally unsealed. Thus, the position of an intangible asset on such 
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grids is not subject to quantitative analysis. As a result of all of the above, such 
systems produce a grid which is largely judgmental and arbitrary. 

Another known system of analysis is the Blake Managerial Grid, discussed in 
detail in "The Managerial Grid," Robert R. Blake and Jane Mouton, Gulf Publishing 
Company, Library of Congress Number 64-14724, 1964, which is incorporated herein 
by reference. This grid is used to display different management styles, with one axis 
representing a concern for production and the other representing a concern for people. 
Different positions on the grid are used to represent different management approaches, 
ranging from autocratic to highly permissive. However, The Blake Managerial Grid, 
like the Risk Management Matrix, results in a positioning which is not arrived at 
through any disciplined procedure, is not subject to quantitative analysis, and is largely 
judgmental and arbitrary. 



SUMMARY OF THE INVENTION 



It is therefore an object of the invention to provide an improved system for 
measuring the value or performance of a technology, an organization, or other 
intangible asset of interest. 

The process of the invention provides a graphical illustration of the performance 
or value of an asset by (1) establishing first and second variables related to the value of 
the intangible asset of interest, (2) establishing a series of performance criteria statements 
probative of the value of the first and second variables, (3) generating first and second 
total scores based upon the extent to which individual statements accurately describe the 
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intangible asset of interest, (4) creating a chart having a first axis relating to the first 
variable and a second axis relating to the second variable, (5) plotting a point on the 
chart, the point being located at coordinates corresponding to the first and second total 
scores, respectively, and (6) using the chart in making at least one decision regarding 
the value of said intangible asset of interest. 

The process of the invention according to a preferred embodiment provides a 
valuation grid which can be a means for performing, e.g., a quantitative comparison 
of organizations of a given class, a comparative analysis of various technological assets 
for venture capital pools, or a quantitative positioning of the level of achievement of 
an organization with respect to the vision and mission established by its owners. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, features, and advantages of the invention will 
be apparent from the following more particular description of preferred embodiments 
as illustrated in the accompanying drawings. The drawings are not necessarily to scale, 
emphasis instead being placed upon illustrating principles of the invention. 

FIG. 1(a) illustrates a matrix of performance areas reflecting the value or 
performance of a for-profit company. 

FIG. 1(b) illustrates a matrix of performance areas reflecting the value or 
performance of a research and development organization. 

FIG. 1(c) illustrates a matrix of performance areas reflecting the value or 
performance of a university. 



217218 



FIG. 1(d) illustrates a matrix of performance areas reflecting the value of a 
technical asset. 

FIG. 2 illustrates examples of performance criteria for cell A2 of the matrix 
shown in FIG. 1(b). 

FIG. 3 illustrates a performance criteria scoring form. 

FIG. 4 illustrates a valuation grid produced according to the process of the 
invention. 

FIG. 5 is a table illustrating names and definitions for grid positions in 
valuation grids for various organizations and assets. 

FIG. 6 is a graphical representation of performance area scores created 
according to the system of the invention. 



DETAILED DESCRIPTION OF THE INVENTION 



The performance or value of an organization, technology, or other intangible 
asset can depend on, and be described in terms of, two or more independent variables. 
The first step in carrying out the process of the invention is to define at least two 
independent variables which best reflect such performance or value of the particular 
organization or asset under analysis. For example, the value of a particular technology 
or technical asset can be understood in terms of its commercial strength versus its 
technical strength; the value or position of a university can be understood in terms of 
its teaching excellence versus its research excellence; the value of a research and 
development organization can be described in terms of its short-term performance 



versus its long-term performance; and, the value of a private sector company can be 
understood in terms of the strength of today's business versus the strength of 
tomorrow's business. The particular pair of independent variables, including but not 
limited to those pairs listed above, should be selected according to the type of 
organization or asset to be evaluated. 

For purposes of illustrating the principles of the present invention, the 
embodiments described herein utilize two independent variables in implementing a 
valuation; however, it will be appreciated by those skilled in the art that a number of 
variables greater than two could be utilized without departing from the spirit and scope 
of the invention. 

Once the first step of selecting at least two independent variables has been 
performed, the second step according to the process of the invention is to establish a 
series of performance criteria statements probative of the value of the First and second 
variables. This preferably begins with creation of an array, or matrix, of performance 
areas, i.e., areas which are considered to be important in evaluating the organization 
or asset. Examples of performance matrices for various organizations and assets are 
shown in FIGS, la- Id. As will be noted from the figures, the columns A, B, C, etc. 
preferably vary in either time, spatial, or geographical focus. On tlie other hand, the 
rows 1, 2, 3, etc., preferably reflect specific areas of activity or focus. 

A number of performance criteria, including performance statements, are then 
created for each cell in the performance matrix. FIG. 2 illustrates ten performance 
criteria relating to the performance area in cell A2 ("program management") of the 
performance matrix shown in FIG. 1(b). Each of the three statements for one criterion 
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indicates a different level of strength in the performance area to which the criterion 
relates. As will be discussed in more detail below, the process of the invention 
according to a preferred embodiment includes a subsequent step in which an evaluator 
selects, from among the three or four statements for each of the criteria, the one 
statement which most accurately describes the organization or asset being assessed. 

As illustrated in FIG. 2, all of the performance criteria relating to the "program 
management" performance area are grouped together; however, it may be preferable 
in some cases to scramble the criteria so that performance criteria relating to one 
performance area are interspersed with performance criteria relating to other 
performance areas. Such scrambling can avoid bias during the subsequent selection 
step. 

The performance criteria can be defined by persons with extensive experience 
in the type of organization or asset being evaluated, or can be selected from a data base 
of previously-established matrices for similar organizations. 

The performance statements preferably have rating levels and axis-weighting 
factors associated with them. With respect to rating levels, these are identified in FIG. 
2 as rating levels 1, 2, and 3 along the top row of the chart. In the example shown in 
FIG. 2, statements which reflect a low degree of program management are assigned 
a rating level of 1, statements which reflect a moderate degree of program management 
are assigned a rating level of 2, and statements which reflect a high degree of program 
management are assigned a rating level of 3. If only one statement is used for each 
performance criteria, it is preferable to assign to it the highest rating level, and a range 
of numbers used to reflect how close the organization or asset meets the conditions of 
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that statement. For example, an evaluator could be given a series of single statements 
and be asked to rate each statement on a scale of 0 to 3, with a rating of zero indicating 
a low level of compliance with the statement by the organization/intangible asset and 
a rating of 3 indicating a high level of such compliance. However, the three-statement 
method, as shown in FIG. 2, is preferred for most applications. 

With respect to assignment of axis-weighting factors, this is necessary for 
accurately plotting the orthogonal relationship between the two independent variables 
selected above in step 1. Assignment of axis-weighting factors for each of the criteria 
serves to apportion the rating level of that criteria to the X-axis and Y-axis, 
respectively. The two right-hand columns in FIG. 2 illustrate assigned weighting 
factors. The preferred method of performing the assignment is to apportion the value 
of unity between the two axes; for example, assigning a weighting factor of 1.0 to the 
X-axis and a weighting factor of 0.0 to the Y-axis would indicate that the criteria 
contributed entirely to X-axis performance. Likewise, assigning 0.0 to the X-axis and 
1.0 to the Y-axis would indicate that the criteria contributed entirely to Y-axis 
performance; and, assigning 0.5 to each of the axes would indicate that the contribution 
was equally divided between the two axes. 

The third step is to undertake the assessment and calculate scores for each of 
the independent variables. An evaluator is given a complete set of forms similar to that 
shown in FIG. 2, but with criteria for each of the performance areas on the appropriate 
performance matrix, and he selects (e.g. , by circling) for each of the criteria the one 
statement which best describes the organization or asset being evaluated. The 
assessment may be undertaken by a range of stakeholders, such as the staff of an 
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organization at various organizational levels, the owners, key clients, or alliance 
partners. 

Once the assessment has been undertaken, the results are preferably compiled 
in a form as shown in FIG. 3. In the example of FIG. 3, there are 96 criteria for the 
ten performance areas shown in FIG. lb. In this particular example, a three-level 
rating was used, with a numerical rating of 0 assigned to statements which reflect the 
lowest performance in the corresponding performance area, a numerical rating of 1 
assigned to statements which reflect a moderate performance in the performance area, 
and a numerical rating of 2 assigned to statements which reflect a high performance in 
the performance area. 

For each criteria, the rating level of the statement selected is multiplied by the 
X-axis weight to obtain the X-axis contribution, and by the Y-axis weight to obtain the 
Y-axis contribution. The X-axis contributions are summed and the Y-axis 
contributions are summed; the resulting totals are shown at the bottom right of the form 
in FIG. 3. In the example of FIG. 3, the X total is 72.5 out of a maximum 96, and 
the Y total is 47.5 out of a maximum 96. 

The fourth step is to plot the X-axis total and the Y-axis total on an evaluation 
grid, with the independent variables as axes. FIG. 4 illustrates such an evaluation grid 
resulting from application of the process of the invention to a research and development 
organization. The grid shown in FIG. 4 comprises a ten-point scale; thus, the total 
values obtained above of 72.5 for the X-axis and 47.5 for the Y-axis correspond to plot 
positions of 7.6 and 4.9, respectively, on the grid. 
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To make the graphical illustration shown in FIG. 4 more meaningful, it is 
preferable to assign names to each of the four quadrants in the evaluation grid. In FIG. 
4, the quadrants are assigned the names "Transformer," "Pacesetter," "Improver," and 
"Still Evolving." FIG. 5 illustrates names and definitions associated with the quadrants 
in four types of evaluation grids. 

A valuation grid for a technology would show the positioning of the technology 
in one of the four quadrants, e.g., "Specialty" in an upper left quadrant, "Pacesetter" 
in an upper right quadrant, "Commodity" in a lower right quadrant, and "Not Ready" 
in a lower left quadrant. At the inception of a new idea, the technology may be 
considered to lie at the origin. As the idea matures into a bona technology, it will 
follow a trajectory through the "Not Ready" quadrant to one of the other three 
quadrants. If the technology follows a forty-five degree diagonal, this indicates that 
technical and market developments are proceeding in parallel. If the market develops 
faster than the technology, the trajectory will move into the "Commodity" quadrant; 
conversely, if technical progress proceeds faster than market development, the 
trajectory will move into the "Specialty" quadrant. The position in which the trajectory 
terminates determines the overall merits of the technology. The higher the trajectory 
proceeds into the "Pacesetter" quadrant, the more likely it is that tliere will be a high 
level of commercial success. 

It is also useful to create a chart showing the scores for each of the performance 
areas. Such a chart is illustrated in FIG. 6. This step provides a more-detailed 
graphical representation of the information represented in the evaluation grid by 
identifying the specific strengths and weaknesses of the organization or asset being 
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evaluated. If the performance criteria have been scrambled as described above with 
regard to the third step, it may be necessary to unscramble the criteria in order to 
obtain scores for each performance area. 

The final step is to interpret the results for purposes of making decisions 
regarding the value of the intangible asset or organization. Such decisions include, 
e.g., whether to invest capital in a technology, how to develop a strategic plan to 
optimize an asset's future value, which programs to fund among competing programs 
within an organization, and whether an organization has met a level of achievement set 
forth in a mission established by its owners. 

Depending upon which evaluators have undertaken the analysis, various 
conclusions can be drawn from the results, and those conclusions can be of importance 
to various stakeholders. Regarding the four particular types of organizations/assets 
described herein (i.e., a company, a research and development organization, a 
university, and a technology), the process of the invention provides quantitative 
information in at least the following areas. 

With respect to companies, managers of companies are expected to manage the 
current business activities of the company in an efficient and cost-effective manner, and 
at the same time ensure long-term survival of the company by developing new business 
opportunities to replace maturing and aging products and markets; the process of the 
invention quantitatively identifies how well the company has met these two objectives. 

With respect to research and development organizations, the owners and 
managers of such organizations must meet the short-term needs of their clients, and 
also renew their intellectual capital through longer-term scientific and technological 
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investigations, making the large transformations needed to create future business 
opportunities; the process of the invention will identify how successful the managers 
have been in meeting these objectives. 

With respect to universities, such institutions differ in their respective emphasis 
on research and teaching; the process of the invention makes it possible to measure 
their performance with respect to these sometimes-competing responsibilities and to 
achieve the balance desired by the Board of Governors. 

With respect to technologies, technology commercialization is made difficult 
by the high risks involved in introducing new ideas into the marketplace. The process 
of the invention provides a measurement of the technical and commercial readiness of 
new technologies and enables investors to choose between competing proposals. 

While the invention has been particularly shown and described with reference 
to a preferred embodiment thereof, it will be understood by those skilled in the art that 
various changes in form and details may be made therein without departing from the 
spirit and scope of the invention. For example, a system having three statements per 
performance criteria has been illustrated above. However, in some applications, such 
as a technology assessment applications, a four-statement approach may yield better 
separation. * 
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The embodiments of the invention in which an exclusive property or privilege 
is claimed are defined as follows: 

1. A method of evaluating an intangible asset of interest, comprising the steps of: 

establishing first and second variables related to the value of said intangible asset 
of interest; 

establishing a series of performance criteria statements probative of the value of 
said first and second variables; 

generating first and second total scores based upon the extent to which individual 
statements accurately describe said intangible asset of interest; 

creating a chart having a first axis relating to said first variable and a second axis 
relating to said second variable; 

plotting a point on said chart, said point being located at coordinates 
corresponding to said first and second total scores, respectively; and, 

using said chart in making at least one decision regarding the value of said 
intangible asset of interest. 

2. The method of claim 1, wherein said generating step comprises ftie steps of: 

choosing, from sets of performance criteria statements in said series, individual 
statements which most accurately describe said intangible asset of interest; 

determining, for each said set of performance criteria statements, first and second 
scores based at least in part on the particular statement chosen from the set, said first and 
second scores relating to said first and second variables, respectively; 
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summing a plurality of said first scores to obtain a first total score relating to said 
first variable; and, 

summing a plurality of said second scores to obtain a second total score relating 
to said second variable. 

3. The method of claim 1, further comprising the steps of: 

assigning to each said performance criteria statement first and second weighting 
factors reflecting an extent of impact of said statement on said value of said first and 
second variables, respectively; 

using said weighting factors in determining said first and second total scores. 

4. The method of claim 1, further comprising the step of: 

placing a label in each of four quadrants of said chart, each label representing the 
extent to which points in a quadrant reflect a balance between said first and second 
variables. 

5. The method according to claim 1, wherein said first and second variables comprise 
two independent variables. * 

6. The method according to claim 1, wherein said intangible asset of interest comprises 
a technological asset and wherein said first variable comprises commercial strength. 
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7. The method according to claim 1, wherein said intangible asset of interest comprises 
a technological asset and wherein said second variable comprises technical strength. 

8. The method according to claim 1, wherein said intangible asset of interest comprises 
a technological asset and wherein said first variable comprises commercial strength and 
said second variable comprises technical strength. 

9. The method according to claim 1, wherein said intangible asset of interest comprises 
a research and development organization and wherein said first variable comprises short- 
term performance. 

10. The method according to claim 1, wherein said intangible asset of interest comprises 
a research and development organization and wherein said second variable comprises 
long-term performance. 

11. The method according to claim 1, wherein said intangible asset of interest comprises 
a research and development organization and wherein said first variable comprises short- 
term performance and said second variable comprises long-term performance. 

12. The method according to claim 1 ? wherein said intangible asset of interest comprises 
a university and wherein said first variable comprises research excellence. 
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13. The method according to claim 1, wherein said intangible asset of interest comprises 
a university and wherein said second variable comprises teaching excellence. 

14. The method according to claim 1, wherein said intangible asset of interest comprises 
a university and wherein said first variable comprises research excellence and said 
second variable comprises teaching excellence. 

15. The method according to claim 1, wherein said intangible asset of interest comprises 
a private-sector company and wherein said first variable comprises the strength of 
today's business. 

16. The method according to claim 1, wherein said intangible asset of interest comprises 
a private-sector company and wherein said second variable comprises tomorrow's 
business. 

17. The method according to claim 1, wherein said intangible asset of interest comprises 
a private-sector company and wherein said first variable comprises the strength of 
today's business and said second variable comprises the strength of tomorrow's 
business. 

18. 'A chart for providing a graphical indication of the value of an intangible asset of 
interest, wherein said chart is created according to the method of claim 1 . 
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Grid 
Position 




Company 


Market Leader 


10,0 


Current products and services dominate the 
market; there is no emphasis on developing 
new products and services. 




Innovator 


0,10 


New products and services are being 
developed, with little effort towards defining or 
creating a market demand. 




Pacesetter 


10,0 


Well-balanced company, a market leader with 
current products and services, having active 
programs to develop new customers, new 
products and new services. 




Still evolving 


0,0 




no r\ 

Organization 


Improver 


10,0 


Meets the technical needs of current 
customers, with effective continuous 
improvement programs. 




Transformer 


0,10 


Developer of major new processes and 
products, and/or extending the boundaries of 
science, with no immediate market connection. 




Pacesetter 


10,10 


Well-balanced organization, effective in 
meeting the needs of current clients, but 
constantly developing and searching for new 
clients, new products and new services. 




Still evolving 






University 


Teaching University 


10,0 


University well-recognized for exceptional skills 
in teaching. 




Research Institute 


0,10 


Research institute with a university style 
structure but exclusively focused on research 
and extending the boundaries of knowledge. 




Research University 


10,10 


University which has effectively coupled its 
teaching and research skills. 




Still evolving 
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Technical Asset 


Commodity 


10,0 


A product or service having high current 
market acceptance with minimum technical 
content. 




Specialty 


0,10 


A highly technical product or service which has 
an i!l-defined or small existing or potential 
market. 




Pacesetter 


10,10 


A highly technical product or service that has 
or is expected to have a major market impact. 




Not ready 


0,0 
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